Negation's Not Solved: Reconsidering Negation Annotation and Evaluation
نویسندگان
چکیده
s (1,273 abstracts also in the GENIA corpus). Here, the scope of negation is specified as the maximum span within which the negation cue word could be applicable, and the scope cannot be disjoint from the cue word. This is in contrast to the negation annotations we explore; we do not explore scope annotations for two reasons: First, the lack of gold standard named entity mentions is an additional source of error that no other corpus would have, making the comparison unfair. Second, while such scope annotations overcome some recall issues for
منابع مشابه
Negation’s Not Solved: Generalizability Versus Optimizability in Clinical Natural Language Processing
A review of published work in clinical natural language processing (NLP) may suggest that the negation detection task has been "solved." This work proposes that an optimizable solution does not equal a generalizable solution. We introduce a new machine learning-based Polarity Module for detecting negation in clinical text, and extensively compare its performance across domains. Using four manua...
متن کاملExplorer Detecting negation scope is easy , except when it isn ’ t
Several corpora have been annotated with negation scope—the set of words whose meaning is negated by a cue like the word “not”—leading to the development of classifiers that detect negation scope with high accuracy. We show that for nearly all of these corpora, this high accuracy can be attributed to a single fact: they frequently annotate negation scope as a single span of text delimited by pu...
متن کاملDetecting negation scope is easy, except when it isn't
Several corpora have been annotated with negation scope—the set of words whose meaning is negated by a cue like the word “not”—leading to the development of classifiers that detect negation scope with high accuracy. We show that for nearly all of these corpora, this high accuracy can be attributed to a single fact: they frequently annotate negation scope as a single span of text delimited by pu...
متن کاملSpeculation and negation annotation in natural language texts: what the case of BioScope might (not) reveal
In information extraction, it is of key importance to distinguish between facts and uncertain or negated information. In other words, IE applications have to treat sentences / clauses containing uncertain or negated information differently from factual information that is why the development of hedge and negation detection systems has received much interest – e.g. the objective of the CoNLL2010...
متن کاملThe Scope and Focus of Negation: A Complete Annotation Framework for Italian
In this paper we present a complete framework for the annotation of negation in Italian, which accounts for both negation scope and negation focus, and also for language-specific phenomena such as negative concord. In our view, the annotation of negation complements more comprehensive Natural Language Processing tasks, such as temporal information processing and sentiment analysis. We applied t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013